Skip to content

[VL] Add config spark.gluten.sql.columnar.backend.velox.maxExtendedPartialAggregationMemory#11354

Merged
jinchengchenghh merged 1 commit intoapache:mainfrom
Zouxxyy:dev/add-agg-conf
Jan 7, 2026
Merged

[VL] Add config spark.gluten.sql.columnar.backend.velox.maxExtendedPartialAggregationMemory#11354
jinchengchenghh merged 1 commit intoapache:mainfrom
Zouxxyy:dev/add-agg-conf

Conversation

@Zouxxyy
Copy link
Contributor

@Zouxxyy Zouxxyy commented Jan 4, 2026

What changes are proposed in this pull request?

Add conf spark.gluten.sql.columnar.backend.velox.maxExtendedPartialAggregationMemory

"Set the max extended memory of partial aggregation in bytes. When this option is set " +
  "to a value greater than 0, it will override spark.gluten.sql.columnar.backend.velox." +
  "maxExtendedPartialAggregationMemoryRatio. Note: this option only works when " +
  "flushable partial aggregation is enabled. Ignored when " +
  "spark.gluten.sql.columnar.backend.velox.flushablePartialAggregation=false.

How was this patch tested?

Copy link
Member

@zhztheplayer zhztheplayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks.

@jinchengchenghh jinchengchenghh merged commit ea9ba24 into apache:main Jan 7, 2026
111 of 113 checks passed
QCLyu pushed a commit to QCLyu/incubator-gluten that referenced this pull request Jan 8, 2026
QCLyu pushed a commit to QCLyu/incubator-gluten that referenced this pull request Jan 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants